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(54) Title: METHOD AND APPARATUS FOR SIGNAL DEGRADATION MEASUREMENT 
(57) Abstract 

A method of measuring the degradation of a data stream owing to the influence of errors 
thereon is disclosed. Unlike known degradation measures, a measure calculated in accordance 
with the present invention takes into account the variation in the significance of an error in 
dependence upon the elements which are affected by it. A particular application of the method 
to the selection of one of a number of possible speech coding methods for use in transmitting 
speech across a radio link (20) from a mobile phone (10) to a base station (30) is described. 
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METHOD AND APPARATUS FOR SIGNAL DEGRADATION MEASUREMENT 



The present invention relates to methods of, and apparatus for, measuring the 
degradation of a data stream. It has particular utility in relation to providing a 
5 measure for use in selecting a speech coding rate for use over a radio 
communication link between a mobile telephone and a fixed network. 

Conventionally, degradation of a data stream has been estimated on the basis of a 
measurable parameter of the channel over which the data stream has been sent. 
10 For example, the degradation of coded speech carried over a radio channel has 
hitherto been estimated on the basis of a measured radio channel parameter such 
as the Carrier to Interferer (C/l) ratio or the Bit Error Rate. In practice, it is found 
that such estimates are unreliable indicators of . the degree of degradation 
experienced by the data stream. 

15 

European patent application no. 0 798 888 discloses a speech encoder/decoder for 
use in a mobile telephone. The encoder divides the incoming speech into frames 
and derives a set of speech parameters for each frame. The decoder is operable to 
receive decoded speech parameters for a frame and to determine whether they 

20 contain errors that are so significant that they are unsuitable for generating 
synthesised speech. In making the determination, the encoder arranges the bits it 
outputs according to their importance to the quality of the decoded speech. Each 
bit is associated with an importance class which is in turn associated with a 
importance value. A checksum is applied to each class of bits at the encoder. The 

25 decoder analyses the checksum and thereby indicates whether the associated 
class contains any errors. The importance values for those classes which contain 
errors are then added together and their sum is compared to a threshold. If the 
sum exceeds the threshold then the decoded parameters are deemed unsuitable for 
generating synthesised speech. 

30 

EP 0 798 888 discloses a measure of the degradation of one section of a data 
stream. When measuring the degradation of a data stream comprising a plurality 
of sections, it is not obvious that the measure for one section is any better than 
the conventional measurements of Bit Error Rate. 
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A first aspect of the present invention provides a method of measuring the 
degradation caused by the influence of errors on a data stream comprising a 
plurality of sections, said method comprising the steps of: 
5 retrieving stored error significance values associated with respective error 

significance classes of one or more digits of a section of said data stream; 

determining error likelihood measures for respective error likelihood classes 
of one or more digits in said section; 

calculating a degradation measure on the basis of the sum over said 
10 section of said error likelihood measure for each digit weighted by the error 
significance value associated with that digit. 

The present inventor realised that such a degradation measure (i.e. one based on a 
sum over a section of an error likelihood estimate for each digit weighted by an 

15 error significance value for each digit) is a better measure of the degradation of a 
data stream than a Bit Error Rate or the like. This is because many coding 
schemes are designed to give an inverse correlation between the likelihood of a 
received digit being in error and the significance of an error in that digit. Where 
there is such a correlation, the coding scheme will operate to reduce the impact of 

20 an increase in Bit Error Rate. The measure according to the present invention 
takes the effect of such coding schemes into account. 

It is anticipated that, in the majority of embodiments of the present invention, said 
digits will be bits (binary digits). The invention might also be applied to other 
25 forms of coding such as quaternary or octal coding. 

In some embodiments, said error significance classes comprise bits at 
predetermined positions in the sections, and said error significance values 
retrieving step involves determining the class to which a bit belongs on the basis 
30 of the position of said bit within the section. 

Some channel encoding/decoding algorithms provide a measure indicative of the 
likelihood of error in each decoded bit. Hence, in some embodiments said error 
likelihood measures are provided on the basis of an error likelihood measure 
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provided for each bit by a channel decoding method. This has the advantage that 
the calculation of the degradation measure can be implemented without increasing 
the bit-rate of the transmitted signal. 

5 As stated above, one application of the present invention is in the selection of a 
coding scheme to be used over a communication link between a sender which is 
operable to encode a signal using a selected one of a number of possible coding 
methods and a receiver. Therefore, according to a second aspect of the present 
invention, there is provided a method of selecting a signal encoding method for use 
10 over a communications link, said method comprising: 

carrying out a method according to the first aspect of the present 
invention to determine said degradation measure on the basis of a received portion 
of said data stream; and 

selecting one of a plurality of encoding methods on the basis of said 
1 5 degradation measure. 

According to a third aspect of the present invention, there is provided a method of 

measuring the degradation of a section of a data stream owing to the influence of 

errors thereon, said method comprising the steps of: 
20 retrieving stored error significance values associated with respective error 

significance classes of one or more digits of said section; 

said method being characterised by: 

determining error likelihood estimates for. respective error likelihood classes 

of one or more digits in said section; 
25 calculating a measure of said degradation on the basis of the sum over 

said digits of said error likelihood estimate for each digit weighted by the error 

significance value associated with that digit. 

By determining an estimate of the likelihood of each digit of the section being in 
30 error, a more precise measure of the degradation suffered by a section of the data 
stream transmitted across a communication link is obtained. This is useful in 
situations where it is important to determine more precisely the extent to which a 
group of digits has been corrupted. The term estimate is intended to exclude 
variables that have only two possible values. 
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By way of example only, specific embodiments of the present invention will now 
described with reference to the accompanying drawings, in which: 

5 Figure 1 is a schematic illustration of part of a network providing mobile telephony; 

Figure 2 is a schematic illustration of components of a channel decoder used in the 
network; and 

0 Figure 3 is a flow chart illustrating the operation of the receiver which contains the 
channel decoder. 

A first embodiment (a mobile radio speech transmission system) is schematically 
illustrated in Figure 1. A mobile telephone 10 includes a microphone 12 which 

5 receives a user's voice and samples it at 1 25 microsecond intervals to provide a 
binary data stream. This data stream is then passed to an speech encoder 14 
which operates on one block of samples at a time (the blocks of samples are 
known as a 'frames' in the art) to provide a compressed data stream representing 
the user's speech. The compressed data stream passes to a channel encoder 16 

0 which further adds error detection and correction bits to the compressed data 
stream to provide a transmission data stream (in practice, the mobile phone 10 will 
also encrypt the speech data at some stage in the encoding process). The 
transmission data stream is then used to modulate a radio carrier signal which is 
transmitted from the antenna 18 of the mobile phone 10 across a radio link 20 to a 

5 base station 30. 

The mobile telephone 10 is operable to use three different speech/channel coding 
methods. In all three cases, the blocks of samples input to the speech encoder 14 
represent 20ms of the user's voice. 



0 



A first speech/channel coding method (method A) involves the phone 10 operating 
in accordance with the Global System for Mobile communications (GSM) full-rate 
standard. In other words, each input speech frame is processed by the speech 
encoder 14 to give a set of 260 bits (i.e. the speech is coded at ^kbits'). 182 of 
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the 260 bits are known as class 1 bits, the remaining 78 bits are known as class 2 
bits. The set of class 1 bits comprises 50 class 1A bits and 132 class 1B bits. 
The class 1A bits are deemed especially important to speech quality. The class 1B 
bits are deemed to be less important than the class 1A bits, but more important 
than the class 2 bits. The channel encoder 16 applies a 3-bit Cyclic Redundancy 
Checksum to the class 1A bits before adding four tail bits and performing 
convolution coding. These processes add 196 error detection and correction bits 
to the class 1 bits. In contrast, no further processing of the class 2 bits takes 
place in the channel encoder 16. This increases the data rate of the transmission 
data stream sent across the radio link 20 to 22.8kbits*\ 

A second coding method (method B) involves the speech encoder 14 producing 
speech coded at 1 0kbits^'and the channel encoder 16 adding 12.8kbits*\ 

A third speech coding method (method C) involves the speech encoder 14 
producing speech coded at 8kbits 1 and the channel encoder 16 adding 14.8kbits"\ 

As will be known by those skilled in the art, the error characteristics of the link 20 
change over time owing to radio propagation effects such as attenuation, fading 
and shadowing. In low error conditions scheme A will provide the best overall 
speech quality, owing to the high speech coding rate; in very high error conditions 
scheme C will provide the best overall speech quality, owing to the increased 
robustness; scheme B will be best in medium error conditions. 

The selection of the speech coding method to be adopted by the mobile phone 10 
in encoded the user's speech for transmission across the radio link 20 is made at 
the base station 30. Once the base station 30 determines the speech coding 
method to be adopted it sends a signal across the radio link 20 which controls the 
mobile phone 10 to encode speech using the selected method. 

The method by which the base station determines which speech coding method is 
to be used is described below with reference to Figures 2 and 3. 
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Figure 2 shows two components of a channel decoder 40 which forms part of the 
base station 30. The radio carrier signal is demodulated at the base station 30 to 
recreate as accurately as possible the transmission data stream. The recreated 
transmission data stream will normally differ from the transmitted data stream 

5 owing to errors being introduced in transmission across the link 20. The soft 
output Viterbi equaliser 42 receives the recreated transmission data stream and, in 
effect, adjusts the data stream to compensate for measurable characteristics of 
the radio link 20. The operation of the equaliser and the training sequences added 
to the transmitted data stream in order to control its operation will be understood 

0 by those skilled in the art. 

Importantly for the present embodiment, the Viterbi equaliser 42 outputs both the 
estimated true value of each of the bits within the recreated transmission data 
stream and a value which indicates the probability that the bit is in error. In more 
5 detail, the equaliser operates in accordance with the well known Soft Output 
Viterbi Algorithm (SOVA) described in J. Hagenauer and P. Hoeher, "A Viterbi 
Algorithm with Soft-Decision Outputs and its Applications", Proc. GLOBECOM, 
PP1680 - 1686 (1989), which is incorporated herein by reference. The equaliser 
therefore outputs a log likelihood value for each bit according to the following 
!0 equation: 



Pi j 



Equation (1 ) 



where sd, and p, are the log likelihood value and probability of error for the I th bit of 
5 the transmission data stream respectively. The log likelihood values for the class 2 
bits are passed to a speech coding method selection unit 50. The log likelihood 
values for the 378 bits generated from the 182 class 1 bits are passed to a soft 
output Viterbi decoder 44. The Viterbi decoder 44 also uses the SOVA algorithm 
and regenerates the 182 class 1 bits together with a log likelihood value for each 
0 class 1 bit indicating the probability that the bit is in error. It will be realised that 
the log likelihood values associated with the class 1 bits will normally be higher 
than those associated with class 2 bits. 
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The operation of the speech coding method selection unit 50 will now be described 
with reference to Figure 3. 

Firstly, in step 60, the log likelihood values for the class 1 bits are obtained. These 
5 values are then processed and averaged (step 62) to give a mean probability of 
error value for the class. This is done in accordance with the following equation: 



where sd ik is the log likelihood value associated with the I th bit of class k, L k is the 
number of bits in class k; p k is an average probability of an error in any given bit 
in class k (k being set to 1 in step 62, L } therefore being 182). 

15 A process similar to that carried out in steps 60 and 62 is then carried out on the 
using the class 2 log likelihood values in steps 64 and 66. 

Error significance values representing the significance of errors in the two classes 
are then obtained from memory in the speech coding and selection unit 50 (step 
20 68). One method by which these values (which are constant over time) might be 
arrived at is described later. 

A sum over the classes of the averaged probability of error for the class weighted 
by the error significance values associated with the class is then calculated (step 
25 70). This calculation may be represented by the equation: 




Equation (2) 



10 



E(N) = ^ p k r k Equation (3) 



30 where r k is the error significance value associated with class k, K is the number of 
classes (i.e. 2 in the present case) and p k is as defined above. 
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The logarithm of the weighted sum is then calculated in step 72. This provides a 
log weighted sum represented by the equation: 

£(^) = -101og l0 |;(^X7— . Equation (4) 

Where E(SNR) represents the log weighted sum which is, in effect, an expected 
value of the signal to noise ratio of the recreated transmission data stream. 

In practice, it has been found that measures based on 20ms frames are noisy, and 
a better measure is produced by filtering the estimated SNR figure over a small 
number of frames using a moving average filter. The final degradation measure M 
for frame / is therefore calculated in accordance with the following equation (step 
74): 



j N-l 

M j=TfH Sj-^SNR) Equation (5) 



where N is the length of the averaging filter in frames; and Ej(SNR) is the 
estimated expectation of the SNR calculated according to Equation (4) for frame /. 
For 20ms frames a good value of N is 10, which is equivalent to a measurement 
window of t = 200ms. 



The degradation measure thus calculated is then used to select the best channel 
coding method (step 76) as follows. For each coding method, two thresholds are 
defined and the following rules used to select the channel coding method at time t 
based on the value of M calculated over the most recent ten frames: 

If current method is A: if M < Th1 then new mode is B; 

if M < Th2 then new mode is C; 



where Th2 < Th1. 
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If current method is B: if M > Th3 then new mode is A; 

if M < Th4 then new mode is C; 

5 where Th3 > Th4. 

If current method is C: if M > 7*5 then new mode is A; 

if M > T6 then new mode is B; 

10 where Th5 > Th6. 

Since a different speech coding algorithm will be used in each method, the 
respective values of M cannot necessarily be compared directly. However, to avoid 
an oscillation between coding methods, the values of the thresholds 777 7 to Th6 
15 should be chosen such that the overall operation of the system exhibits hysteresis. 
That it to say, if the values of M for different methods were comparable, then: 

Th3 > T1 and Th5 > TV, 
Th1 > Th6) 
20 Th6 > T2 and Th6 > T4. 

it will be seen how the degradation measure defined above more reliably indicates 
the impact of errors on the quality of the encoded speech than prior methods that 
have only considered the Bit Error Rate suffered by the data stream as a whole. 
25 As a result an improved selection of channel coding method is provided. 

One procedure for determining values for r k is now described, although other 
methods could be used. First a speech file of a suitable duration, for example 2 
minutes, is processed through a simulation of the speech and channel encoders 
30 (14,16) to produce a reference channel file. This file is then further processed 
through the simulated speech and channel decoder to produce a reference speech 
output file. For each bit position [i,k) a segmental SNR, which is known to the art, 
is calculated between the reference output file, and a degraded output file that is 
produced from the reference channel file with the f h bit in class k inverted in every 
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frame. The segmental SNR value is used since it better predicts the subjective 
effect of additive noise than a normal SNR calculation. Since unity frame energy is 
assumed in the calculation of the metric, we can estimate r k to be: 



/,-. J 



r k ~ 2 ,rfi.\», . Equation <6) 

i=0 IvJ 



0 



where Q u is the segmental SNR expressed in dB, calculated between the reference 
output file and the degraded output file that was produced by inverting the /" bit in 
class k for every frame. 

In practice, the above calculation could be replaced by any measure of the 
degradation introduced by an error in bit position (U). Possible alternatives include 
the use of an objective measurement metric, such as that defined in ITU-T Rec. 
P. 861, or mean opinion scores from subjective tests. 

In many systems, cyclic redundancy check (CRC) bits are employed to detect 
uncorrected errors in the most sensitive bits. In the event that residual errors are 
detected, a bad frame is declared and an error concealment algorithm is invoked 
that estimates the corrupted parameters on the basis of their most recent values. 
The output gain is usually attenuated over successive bad frames until the signal is 
completely muted. A typical muting period might be five 20ms frames. Since the 
error concealment algorithm will generally reduce the subjective effect of bad 
frames, in the case of detected bad frames, the metric in Equation (5) can be 
replaced by a pre-determined constant, which can be decreased over successive 
bad frames to represent the effect of the muting algorithm. Metric values for bad 
frames can be determined in a similar manner to the values for r„. 

In a preferred embodiment the measure M is calculated using a so-called 'bottom 
tracking' algorithm rather than the moving average filter described above. In this 
case, the log weighted sum obtained for the previous frame in step 72 is increased 
by one eighth of a decibel and compared to the log weighted sum obtained for the 
current frame. If the increased log weighted sum is less than or equal to the log 
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weighted sum derived from the current frame then the measure is set to the 
former. If, however, the contrary is true, then the measure is set to the latter. 

In Equation (2) above, the probability measures for the different bits within a 
5 significance class are averaged to provide a single value for each class. In 
alternative embodiments this averaging step is avoided, the values Pj for each bit 
being used instead. 

In the above-described embodiments, two significance classes of bits (class 1 and 
10 class 2) are used. However, any number of classes may be used and in the 
extreme case each class may contain a single bit. 

As a further alternative, the mobile telephone apparatus 10 may carry out the 
calculation of the degradation measure rather than the base station 30. 

15 

Although the above embodiment involves the transmission of encoded speech over 
a radio link, the present invention is applicable to other forms of data and other 
transmission media. The data stream may, for example, include encoded video, 
facsimile or computer data or a mixture of these. The transmission media may, for 
20 example, be microwaves or electrical signals over copper wires. 
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CLAIMS 



1 . A method of measuring the degradation caused by the influence of errors 

5 on a data stream comprising a plurality of sections, said method comprising the 
steps of: 

retrieving stored error significance values associated with respective error 
significance classes of one or more digits of a section of said data stream; 

determining error likelihood measures for respective error likelihood classes 
10 of one or more digits in said section; 

calculating a degradation measure on the basis of the sum over said 
section of said error likelihood measure for each digit weighted by the error 
significance value associated with that digit. 



15 



2. A method according to claim 1 wherein said digits are bits. 



3. A method according to claim 2 wherein said error significance classes 
comprise bits at predetermined positions in the sections, said error significance 

20 values retrieving step involving determining the class to which a bit belongs on the 
basis of the position of said bit within the section. 

4. A method according to claim 1 or 2 wherein said error likelihood values are 
provided by a channel decoding method. 

25 

5. A method according to claim 4 wherein said error likelihood classes 
comprise one bit, said error likelihood values being provided on the basis of an 
error likelihood measure provided for each bit by a channel decoding method. 

30 6. A method of selecting a signal encoding method for use over a 

communications link, said method comprising: 

carrying out the method of any preceding claim to determine said measure 
on the basis of a received portion of said data stream; and 
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selecting one of a plurality of encoding methods on the basis of said 



measure. 



7. A method according to claim 6 wherein said selection is between encoding 

5 methods featuring different proportions of signal coding and channel coding. 



8. 



A method according to claim 6 or 7 wherein said signal represents speech. 



9. 



Apparatus operable to measure the degradation caused by the influence of 



10 errors on a digital data stream comprising a plurality of sections, said apparatus 
comprising: 



means arranged in operation to retrieve stored error significance values for 
respective significance classes of digits, each of said significance classes 
15 comprising one or more digits of said section; 

means arranged in operation to determine error likelihood measures for 
respective error likelihood classes comprising one or more digits of said section; 
and 

means arranged in operation to calculate a measure of said degradation on 
20 the basis of the sum over said section of said error likelihood measure for each 
digit weighted by the error significance value for that digit. 

10. Apparatus according to claim 9 wherein said digits are bits. 

25 11. An apparatus according to claim 10 further comprising: 



input means for receiving a signal encoding said section; 



means arranged in operation to select an encoding method responsive to 



said determination of said measure; and 



means arranged in operation to send an indication of the encoding method 



to be used to the sender of the data stream. 



30 



12. 



A radio communications receiver comprising an apparatus according to any 



one of claims 9 to 11. 
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13. A mobile telephone apparatus comprising an apparatus according to any 
one of claims 9 to 11. 

14. A method of measuring the degradation of a data stream owing to the 
5 influence of errors thereon, said method comprising the steps of: 

determining a plurality of error significance values for respective 
significance classes of bits, each of said significance classes comprising one or 
more bits of said data stream; 

determining an error susceptibility value for each bit in said data stream; 
10 calculating a measure of said degradation on the basis of the sum over 

said bits of said error significance values weighted by said error susceptibility 
values; 

wherein said susceptibility classes comprise one bit, said error 
susceptibility values being provided on the basis of an error likelihood measure 
1 5 provided for each bit by a channel decoding method. 

15. A method of measuring the degradation of a section of a data stream 
owing to the influence of errors thereon, said method comprising the steps of: 

retrieving stored error significance values associated with respective error 
20 significance classes of one or more digits of said section; 
said method being characterised by: 

determining error likelihood estimates for respective error likelihood classes 
of one or more digits in said section; 

calculating a measure of said degradation on the basis of the sum over 
25 said digits of said error likelihood estimate for each digit weighted by the error 
significance value associated with that digit. 
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